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Abstract. We describe algebraic certificates of positivity for functions 
belonging to a finitely generated algebra of Borel measurable functions, 
with particular emphasis to algebras generated by semi-algebraic func- 
tions. In which case the standard global optimization problem with con- 
straints given by elements of the same algebra is reduced via a natural 
change of variables to the better understood case of polynomial opti- 
mization. A collection of simple examples and numerical experiments 
complement the theoretical parts of the article. 



1. Introduction 

Key sums of squares representation results from real algebraic geometry 
have been successfully applied during the last decade to polynomial opti- 
mization. Indeed, for instance, by combining such results with semidefinite 
programing (a powerful tool of convex optimization) , one may approximate 
as closely as desired (or sometimes compute exactly) the global minimum of 
a polynomial over a compact basic semi-algebraic set. Several other exten- 
sions have also been proposed for finding real zeros of polynomials equations, 
minimizing a rational function, and solving the generalized problem of mo- 
ments with polynomial data. For more details on this so-called moment-sos 
approach the interested reader is referred to e.g. |19| and the many refer- 
ences therein. 

Even though questions involving polynomial data represent a sufficiently 
large framework, one may wonder whether this approach can be extended to 
a more general class of problems that involve some larger algebra than the 
polynomial ring. Typical examples are algebras generated by the polyno- 
mials and some elementary functions like the absolute value, trigonometric 
polynomials, exponentials, splines or discontinuous step functions. 

To mention only one classical source of such natural generalizations we 
invoke the original works of Tchebysheff and Markov concerning the limiting 
values of integrals of specific measures with a finite number of prescribed 
moments against non-polynomial functions. A variety of remarkable re- 
sults: first on the theoretical side [131 EL then in statistics [U [101 [TT] . 
numerical integration [3] and not last in the theory of best approximation 
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[29\ [TT] have resulted from Tchebysheff-Markov work. All these researches, 
plus quite recent contingent works, such as wavelet decomposition of func- 
tions, involve non-polynomial moment problems. In this respect, our essay 
provides an algebraic analysis of positivity in the "pre-dual' of concrete dis- 
tribution/measure spaces. The importance of non-polynomial solutions to 
classical problems in the polynomial algebra, such as Hilbert's 17-th Prob- 
lem, was early recognized, see for instance [H[5] and also pQ. 

Contribution. The purpose of this paper is to povide a first step 
in the understanding of Positivestellensatze in algebras generated by non- 
polynomials functions, and to provide a robust relaxation method for the 
numerical verification of the constrained positivity of such functions as well 
as for optimization purposes. 

(a) First we consider the case of an algebra A of functions generated by a 
finite family of functions that contains the polynomials. In this context we 
prove a Positivstellensatz for a function positive on a compact set K C M. n 
defined by finitely many inequality constraints involving functions of this 
algebra. When A is the polynomial ring the set K is a basic semi-algebraic 
set and one retrieves a Positivstellensatz due the second author |23| . 

(b) Further on we consider a slightly different framework. The algebra A 
now consists of functions generated by basic monadic and dyadic relations on 
polynomials. The monadic operations are | • | and (-) 1/p , p = 1,2,..., while 
the dyadic operations are (+, x,/, A,V). Notice that this algebra contains 
highly nonlinear and nondifferentiable functions! We then show that this 
algebra is a subclass of semi-algebraic functions and every element of A has 
the very nice property that it has a lifted basic semi- algebraic representation. 
As in (a) we provide an extension to this algebra of the Positivstellensatz 
due the second author for polynomials |23j . 

(c) Finally, in both cases (a) and (b) we also provide a converging hi- 
erarchy of semidefinite relaxations for optimization. Actually, the original 
problem in the algebra reduces to an equivalent polynomial optimization 
problem in a lifted space. The dimension of the lifting (i.e. the number of 
additional variables) is directly related to the number of elementary opera- 
tions on polynomials needed to define the functions in the description of the 
original problem. Moreover, the resulting polynomial optimization problem 
exhibits a natural sparsity pattern with respect to the lifted variables for 
which the important running intersection property holds true. Therefore, if 
on the one hand one has to handle additional variables, on the other hand 
this increase in dimension is partly compensated by this sparsity patterns 
that permits to apply the sparse semidefinite relaxations defined in [28] and 
whose convergence was proved in [18]. To the best of our knowledge, the 
present article outlines a first systematic generalization of the moment-sos 
approach initiated in |16|. [T71 l2~T] for polynomial optimization to algebras of 
non-polynomial functions and to (global) semi-algebraic optimization. 
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2. Preliminaries and main result 

Although a more general abstract measure space or probability space 
framework is very natural for the main results of the present article, due to 
the optimization theory applications, we confine ourselves to an algebra of 
Borel measurable functions defined on a set of the Euclidean space. 

We start by recalling a few standard definitions from real algebra, [22J. 
Specifically, let X C M. d be a Borel measurable set and let A be a unital 
algebra of real valued Borel measurable functions defined on X. We denote 
by T.A 2 the convex cone of squares of elements of A. A quadratic module 
Q C A is a convex cone containing 1, such that 

{T.A 2 ) -QcQ. 

In practice we deal with finitely generated quadratic modules, of the form 

Q = ZA 2 + Y>A 2 ■ hi + ... + Y,A 2 • h m , 

where h\,...,h m E A. The positivity set of a quadratic module Q is by 
definition 

P(Q) = {x € X : f(x) > 0, V/ € Q}. 

Similarly to complex algebraic geometry, the duality between a quadratic 
module and its positivity set lies at the heart of real algebraic geometry 
[H [22]. An useful tool for implementing this duality is provided by the 
abstract moment problem on the algebra A, from where we import a simple 
definition: we say that the quadratic module Q C A possesses the moment 
property if every linear functional Lei' which is non-negative on Q is 
represented by a positive Borel measure \i supported by P(Q). 

Also, for duality type arguments, we recall the following concept: an 
element / of a convex cone C C A lies in the algebraic interior of C, if 
for every h £ A there exists e > with the property f + th E C for all 
t,0 < t < e. 

The starting point of all representation theorems below is the following 
simple but crucial observation. Unless otherwise stated, all measurable func- 
tions and sets below are meant to be Borel mesurable. 

Proposition 1. Let A be a unital algebra of measurable functions defined 
on the measurable subset X C M. d . Let Q C A be a quadratic module with 
an algebraic interior point and possessing the moment property. 
If a function f € A is positive on P{Q), then f G Q. 

Proof. Assume by contradiction that / ^ Q, and let £ be an interior point 
of Q. By the separation theorem for convex sets, see |12| . or for a historical 
perspective OdS], there exists a linear functional L 6 A satisfying 

L{f) < < L(h), heQ, L(£) > 0. 
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By assumption there exists a positive Borel measure /i, such that 

M°) = / ^A*) a e 

Since > we infer that the measure fj> is non-zero. On the other hand, 
f\p(Q) > an d L(p) < 0, a contradiction. □ 

The converse is also notable: 

Corollary 1. Assume X compact and A C C(X) is a subalgebra of contin- 
uous functions which separates the points of X. Let Q C A be a quadratic 
module with the constant function 1 in its algebraic interior and suppose 
that every f £ A which is positive on P{Q) belongs to Q. Then Q has the 
moment property. 

Proof. Let L € A' be a linear functional satisfying L\q > 0, L(l) > 0. 
Due to the compactness assumption all continuous functions are compara- 
ble to the constant function £ = 1 in the following precise sense: for every 
F € C(X), there is a positive constant C with the property — C£(x) < 
F(x) < C£(x). Then Marcel Riesz extension theorem [26J provides a linear 
functional A € C(X)' which extends L. Hence A is represented by a signed 
measure fi; since the algebra A is dense in C(X) by Stone- Weierstrass the- 
orem, and A(a 2 ) > for all a £ A, we infer that fi is a positive measure. 

In addition, we know by assumption that for every point x £ P{Q) there 
exists h £ Q such that h(x) < and h\ptq\ > 0. Hence 

ha 2 dfx > 0, a G A. 

Again Stone -Weierstrass Theorem implies that x £ supp(//), that is the 
representing measure \x is supported by the closed set P(Q). □ 

Thus the main questions we are faced with at this first stage of inquiry 
are: under which conditions a quadratic module Q has an interior point 
and/or possesses the moment property. While the first question has a simple 
solution, having to do with the boundedness of the positivity set P(Q), the 
second one involves solving an abstract moment problem, it is more delicate, 
but on the other hand has a long and glorious past, with a wealth of partial 
results and side remarks [TU [TUl E] . 

Towards finding solutions to the above two questions we consider only 
a finitely generated algebra A = M[hi, h n ], where h = (hi,...,h n ) is an 
n-tuple of measurable functions on the set X C M. d . Let y = (yi, ...,y„) be 
variables, so that, by noetherianity 

A = R[y]/I, 

where I is a finitely generated ideal of M[y]. The ideal / describes all the al- 
gebraic relations between generators of the algebra. This ideal is in addition 
radical, in the following sense: if p\ + ... + p\ € /, where pi, —,Pk £ ^[y], 
then pi,...,pk £ I, [!]• Indeed, if pi(h) 2 + ... + Pk{h) 2 = as functions 
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defined on X, then p\oh = 0, ...,pk °h = in the algebra A. Denote by "o" 
the usual composition of functions, i.e., with g : R n — > R and / : R —■ R, 
xH(/o#):=/(s(x)). 

Lemma 1. Assume that A = M[h±, ...,/i n ] is a finitely generated algebra of 
measurable functions and let Q C A be a quadratic module. If 1 — (/if + ... + 
hi) G Q, then the constant function 1 belongs to the algebraic interior of Q. 

For a simple algebraic proof we refer to [22] . Already a first approximative 
solution to the moment problem associated to Q is available. 

Proposition 2. Let A = R[/ii, h n ] be an algebra of measurable functions 
defined on the set X C R d and let L G A' be a linear functional which is 
non-negative on the quadratic module HA 2 + (1 — {h\ + ... + /i^))£.4 2 . Then 
there exists a positive measure v , supported by the unit ball in R n , with the 
property 



L(p(h 1 ,...,h n ))= p(y)<My), p £ R[y]- 
•^lly||<i 

Proof. The familiar Gelfand-Naimark-Segal construction can be invoked at 
this moment. In short, define an inner product on the polynomial algebra 
R[y] by 

(p,q) = L(p(h)q(h)), p,qeR[y}. 

Denote by J the set of null-vectors p € J if and only if (p,p) = 0. It is 
an ideal of R[y] by Cauchy-Schwarz inequality. The quotient space R[y]/J 
is endowed then with a non-degenerate inner product structure. Let H be 
its Hilbert space completion. The multiplication operators with the vari- 
ables Mip(y) = yip(y) are self-adjoint and bounded, due to the positivity 
assumption imposed on L: 

(M iP ,M lP ) = L(h 2 p(h) 2 ) < L(p{h) 2 ) = (p,p). 

In addition, the operators Mj mutually commute on the Hilbert space H. 
Thus the spectral theorem gives a positive Borel measure v, with the prop- 
erty 

L(p(h)) = (p, 1) = (p(Mi, M n )l, 1} = J pdv, p G 

In addition, the support of the measure v is contained in the unit ball, as a 
consequence of the spherical contraction assumption M^M\ + ... + M*M n < 
I. □ 

Thus, a quadratic module Q C A = R[/ii, h n ] with (1 — (h 2 + + G 
Q satisfies the moment property if the measure v appearing in the above 
proposition is the push-forward via the map h : X — > R rf of a positive 
measure fi supported by P(Q), that is: 



p(y)<My) = / p(Mx))d/i(x), v e 

y||<i JP(Q) 
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A series of sufficient conditions assuring v = h*n in the above sense are 
discussed next. 

Again for A = M[hi, h n ] consider a finitely generated quadratic module 
Q = ZA 2 + g (h)ZA 2 + gi (h)ZA 2 + ... + g m (h)ZA 2 , where go, ...,g m G R[y] 
and g (y ) = 1 - y\ - ... - y 2 n . Let also the radical ideal I = (p 1 (y ),..., p k (y ) ) . 
Then 

Q = £K[y] 2 + 5o (y)£M[y] 2 + ... + <? m (y)£M[y] 2 ± Pl ZR[y} 2 ± ... ±p fe £M[y] 2 

is a quadratic module in the polynomial algebra K[y]. Its positivity set 
P(Q) is contained in the closed unit ball intersection with the zero set V(I) 
of the ideal /. Note that we have a natural pull-back (substitution) map 

/i*:M[y] — >A, h*(p)=poh, p G R[y], 

and h*(Q) = Q. At the level of positivity sets we obtain 

h(P(Q)) C P(Q), 

but the inclusion might be strict. Indeed, we derive the following direct 
observation. 

Lemma 2. With the above notation, assume that f = p o h G Q, where 
p £ R[y]. Then p is non-negative on P(Q). 

Proof. The assumption / G Q amounts to the algebraic identity 

/ o h = a o h + (g o h) (a o h) H h (g m oh) (<j m o h), 

where cr, (To, ...,<r m <G SM[y] 2 . In its turn, this identity becomes 

/(y) = cr(y) + 5o(y)^o(y) + ••• + 5m(y)^ m (y) + r(y), 

where r € I. By evaluating at a point a G C V(7) we infer 

/(a) = cr(a) + 5o(a)cr (a) + ... + g m (a)a m (&) > 0. 

□ 

We will see in the next section simple examples showing that the positivity 
of a function / on P(Q) does not guarantee in general a decomposition of 
the form / G Q. The gap between the two statements is explained in the 
following general result. 

Theorem 1. Let A = R[h±, h n ] be a finitely generated algebra of measur- 
able functions defined on a measurable set X cR d and let Q be a quadratic 
module with the function 1 in its algebraic interior. Assume that f G A 
is positive on P(Q). Then f G Q, where Q is the pullback by the map 
h : X — > R d of a quadratic module which serves as a positivity certificate 
for the set h(P(Q)). 

Of course the choice of Q is not unique, and it may not be a finitely 
generated quadratic module. For instance, as a first rough approximation, 
one can choose 

Qf = {poh; p\ h{x)n p { Q) > 0}, 
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where Q is the pull-back of Q via the projection map it : R[y] — > A. 

Corollary 2. Assume, in the conditions of Theorem^ that the set h(X) is 
closed in R[y]. Choose an at most countable set of polynomials Vi € R[y], i € 
J, | J\ < oo, with the property 

{y£R n : Vi(y) > 0, i £ J} = h(X) n P(Q). 

Then every element f o h & A which is positive on the set P(Q) can be 
written as 

f o h = cro h + (M - hi - ... - hi) (a o h) + ^2(vi o h){<7i o /i), 

where M > 0, the subset Jo C J is finite and a,ao,ai € £R[y] 2 , i £ Jo. 

The remaining of this section is concerned with particular choices of the 
"saturation" process Q t-> Q and the resulting effective sums of squares 
representations. 

2.1. Examples in algebras of semi-algebraic functions. Let X = R n 

and let A = R[x, /ii(x), ht(x)] for some functions hi : R n — >• R, i = 
1, . . . , t. Consider the set K C R n defined by: 

K := {x € R n : #(x, /n(x), . . . , ^(x)) > 0, j = l,...,m}, (2.1) 

and suppose that K is compact and 

t 

X4M - ||x|| 2 - ^ \ h i{*)\ 2 > on K. 

8=1 

Example 1. Here /ij(x) = \xi\, i = l,...,n (so let |x| = (|xj|). In this case 
y = (yi, . . . , y2n) and one has the algebraic relation yl +i = y 2 , % = 1, . . . , n, 
between the generators, hence A = R[y]/7, with / := (y 2 +1 — y 2 , . . . , y\ n — 
y 2 ). Let's choose the quadratic module with the constant 1 in its algebraic 
interior: 

n m 

Q = ZA 2 + (M-(^2x 2 i +\x i \ 2 ))ZA 2 + Y J ^-A 2 g j (x,\x\) 

t=l j=l 
m 

= ZA 2 + (M — 2||x|| 2 )S^ 2 + S^ 2 5j(x, |x|) 

3=1 

The lifted quadratic module is 

m 

Q = SR[y] 2 + (M- ||y|| 2 )SR[y] 2 + ^EI[y]2 ffj (y) ) 

i=i 

whose positivity support set is the set 

{yet 2 " : M-||y|| 2 >0; 9j (y) > 0, j = 1 . . . , m}. 
On the other hand, P(Q) lives in K C R n . 
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For instance if K = [—1, l] n and t = n with <?j(x) = 1 — x|, j = l,...,t, 
a function such as |xi| 3 + 1/2 belongs to the algebra A, is positive on P(Q), 
but it cannot be written as 

n 

|xi| 3 + 1/2 = <r(x, |x|) + (2n - 2||x|| 2 )cjo(x, |x|) + ^cr i (x, |x|) 5j (x), 

i=i 

with <7, crj € £R[y] 2 . Indeed, such a representation would lift to 

n 

Vl+i + 1/2 = <r(y) + (2n - ||y|| 2 )a (y) + ^ ^(y) 5i (y), 

i=i 

and this is obviously impossible by choosing for example yi = for all 
i ^ n + 1 and y n +i = — 1- 

In order to obtain the correct representation we invoke the main result of 
the previous section, and first consider the image set 

h(X) = {(x,|x|); x£l"}cl 2n . 

This set can be exactly described by the inequalities 

yl+i - yf > 0, yl +i - yf > 0, y n+i > 0; i = l,...,n. 

Therefore, 

h(X) n P{Q) = {y € R 2n : 2n - ||y|| 2 > 0; 9j (x) > 0, j = 1, . . . , t; 

y^+i - y? = 0, y n+i > 0, i = 1, . . . , n}, 

and by Corollary [2j the quadratic module in R[y] generated by the polyno- 
mials that describe the above semi-algebraic set h(X) n P(Q), provide the 
desired certificate of positivity. And so we have: 

Proposition 3. Let K be as in \2.1\) . An element f of the algebra R[x, |x|] 
which is positive on K can be written as 

xi->/(x, [x[) = cr(x, |x|) + (n - ||x|| 2 )a (x, |x|) 

n t 

+^2 \ x i\ °"i( x ) i x i) + J2 9 i(*> i x i)^j( x , i x i) 
i=i j=i 

where a,(Xi,ipj £ SM[y] 2 . 

Example 2. Given two polynomials p,q € M[x], let .4 := M[x,p(x) V <?(x)] 
where a V b := max [a, 6], and let K be as in (|2.ip with i = 1 and /ii = 
p(x) V <?(x). Recall that 2(a V 6) = [a — 6| + (a + 6), and so one may consider 
the new algebra A' = R[x, |p(x) — g(x)|] since a polynomial in the variables 
x and p(x) V <z(x)] is a particular polynomial in x and \p(x) — <?(x)|. In this 
case y = (yi, . . . , y n +i) and one has the algebraic dependency 

y 2 n+1 = (p(x) - g(x)) 2 

and the additional constraint y n+ \ > 0. 



POSITIVITY AND OPTIMIZATION FOR SEMI-ALGEBRAIC FUNCTIONS 



Proposition 4. Let K be as in pOP and let f be an element of the algebra 
A := R[x,p(x) V g(x)]] which is positive on K. Equivalently 

x h-> /(x,p(x) V g(x)]) = /(x, |p(x) - g(x)|), 

/or some f £ A' := R[x, |p(x) — g(x)|], positive on K. T/ien / can 6e written 

/(x,b(x)-g(x)|) = «7(x,|p(x)-?(x)l) 

+(M - ||x|| 2 - |p(x) - g(x)| 2 )o- (x, |p(x) - g(x)|) 
+|p(x) - g(x)|cri(x, |p(x) - g(x)|) 

m 

+ |p(x) - g(x)|)&(x, |p(x) - g(x)|) 

i=i 

w/iere cr, cr i; V>j G ER[yi, . . . , y n +i] 2 - 

Of course a similar thing can be done with p(x) A g(x) := min[p(x), o(x)] 
using 2(a A b) = (a + b) — \a — b\. 

Example 3. Let u = (uj)™ =1 £ R[x] n and let / be an element of the algebra 
A := R[x, ||u(x)|| p ]] which is positive on K, where ||x|| p = (%27=1 \ x i\ P ) > 
with either p £N or p^ 1 £ N. 

lip/2 £ N one uses the algebraic lifting y £ R ra+1 with: 

n 

i=i 

If p = 2q + 1 with q £ N, one uses the algebraic lifting y £ R 2n+1 , with: 

n 

2/ 2 +i = U;(x) 2 ; y P 2n+l = S }2y P n+ii Vn+i > 0, * = 1, • • • , n + 1. 

i=l 

If 1/p £ N one uses the algebraic lifting: 

/ n \ VP 

= ^i(x) 2 ; y 2 n.+i = ( ^ ; yn+i > 0, i = l, . . . , n + 1. 

Proposition 5. Let K be as in h2.1\) and let f be an element of the algebra 
A := R[x, ||u(x)|L] which is positive on K. 
(a) If p/2 £ N then f can be written 

/(x, ||u(x)||p) = <r(x, ||u(x)|| p ) 

+ (Af-||x|| 2 -||u(x)|| 2 )o- (x,||u(x)|| p ) 

rn 

+||u(x)|| p <7i(x, ||u(x)||p) + ^^(x) Vj(x, ||u(x)|| p ) 

3=1 

where <T,a i} ij}j £ £R[yi, . . . , y n +\] 2 ■ 
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(b) If p = 2q + 1 with g£N then f can be written 

/(x, ||u(x)||p) = ff(x,|u(x)|,||u(x)|| p ) 

+(M - ||x|| 2 - ||u(x)|| 2 - ||u(x)|g) a (x, |u(x)|, ||u(x)|| p ) 

n 

+ |tti(x)| <7i(x, |u( X )|, ||u(x)||p) 

1=1 

+ ||u(x)|| p ^(x, |u(x)|, ||u(x)||p) 

m 

+ ^%( x ) ^(x, |u(x)|, ||u(x)||p) 

J'=l 

w/iere a,ai,ipj,(p £ . . . ,y 2 n+i] 2 - 

(c) If 1 < p^ 1 S N i/ien / can &e written 

/(x,||u(x)|| p ) = cr(x, |ui(x)| p ,...,|n n (x)| p , ||u(x)|| p ) 

n 

+ (M-||x|| 2 -^|^(x)|^-||u(x)|| 2 ) 
i=i 

xcr (x, |ni(x)| p , . . . , \u n (x)\ p , ||u(x)||p) 

n 

+ h l (x)| p a l (x, \ Ul (x)\ p , \u n (x)\ p , ||u(x)||p) 
1=1 

+ ||u(x)||p tp(x, Mx)| p , . . . , K(x)| p , ||u(x)||p) 

+ 5Z»( X ) ^'^ x ' • • • ' M s )l p > II u ( x )IIp) 

w/iere <j, <7;, <p, V>j £ T,R[yi, . . . ,y 2n +i} 2 ■ 

Example 4. Let ^4 = R[x, y/p(x)]. Of couse one here considers the new 
basic semi-algebraic set: 

K' := K n {x : g m+1 (x) > 0} with x m- g m +i(x) :=p(x), (2.2) 

and the lifting 

V 2 n+ i = p(x); y n+ i > 0. 

Proposition 6. Zei / be an element of the algebra A := R[x, -\/p(x)] which 
is positive on K'. XTien / can 6e written 

f(x,y/tfx)) = a(x,v / p(x)) + (M-||x|| 2 -p(x)) C 7o(x,VRx)) 

m+l 

i=i 

where a, a i} ip, ipj G £K[yi, . . . , y n+ i] . 
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2.2. Examples in algebras of nonsemi-algebraic functions. 

Example 5. Let X = [0,7r/2] and A = R[x,sinx]. Again y = (2/1,2/2) 
but this time the algebra A is isomorphic to the full polynomial algebra 
R[y]. For illustration we consider the quadratic module Q C A generated 
by the elements x, 7r/2 — x, 1 — sin 2 x. Although the inequality 1 — sin 2 x > is 
redundant, it is necessary to add it for having the function 1 in the algebraic 
interior of Q. 

As we wish to obtain a certificate of positivity for a function /(x, sinx) 
belonging to A, an algebraic description of the graph ofx h> sinx is in order. 
Choose the polynomials 

k 2k-\-l 
X^pJx) = V(-l) fe -4 -T, fc>0. 

F v 1 1 (2fc + l)!' 

It is well known that 

P2k(x) > P2k+2(x) > sinx > P2k+l(x) > P2k-i(x), Vx € [0,7r/2], 

and that these polynomials converge uniformly to sinx on [0, vr/2]. A de- 
scription of the graph of sinx is: 

h(X) = {(x,sinx) : < x < vr/2} = 

{y € R 2 : 0<yi< tt/2, p 2 fe+i(yi) < V2 < P2k(vi), k > 0}. 
In view of our main result, the conclusion is: 

Proposition 7. Let f be an element of the algebra M[x,sinx] and assume 
that f > for all x € [0, vr/2]. Then there exists k > such that 

x i->- /(x, sinx) = cr(x, sin x) + xao(x, sinx) + (ir/2 — x)cJ2(x, sinx)+ 

[P2k(x) - sin x]cr 3 (x, sinx) + [sinx - p 2 fc+i(^)]o-4(2;, sin x), 
where a,ai € SM[y] 2 . 

Example 6. Let A = R and = R[x, e aa: , e b:E ]. Two distinct cases, corre- 
sponding to a,b commensurable or not, will be treated. This dichotomy is 
well known to the experts in the control theory of delay systems. 

To fix ideas, we assume that b > a > and the base is the interval [0, 1]. 
Denote y\ = x, j/2 = e ax ,ys = e bx . We will impose the archimedeanity 
constraints 

x>0,l-x>0, y 2 > 0,e a -y 2 > 0, 2/3 > 0, e b - y 3 > 0. 

Along with these we have to consider the polynomial approximations of the 
two exponentials: 

— a h x k , , a n+1 e a x n+1 



p n (ax) = ^ —Tf- <V2< Pn(ax) + 
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and 

„ , ^b k x k , b n+1 e b x n+1 

Pn(bx) = ^ -rp < 2/3 < Pn(te) + ■ 
fc=0 ' 

The reader will recognize above an upper bound of the remainder of Taylor's 
series approximation of the exponential function. 

Case I. The frequencies a, b are not commensurable. Then there is no alge- 
braic relation among the variables yi, 2/2) J/3 and a function / € e ax , e bx ] 
which is positive on the interval [0, 1] is decomposable into a weighted sum of 
squares generated by x,l — x, e ax ,e a — e ax , e bx , e b — e bx ,e ax — p n (ax) , p n (ax) + 
a n+i^n+i _ ^ ^ bx _ pn (p x ^ pn ( bx ^ + V^_^± _ e bx^ for a large enough 

n. 

Note that the above list of weights is redundant, as for instance the con- 
straint e ax > follows from e ax — p n (ax) > 0, and so on. In practice it will 
be important to identify a minimal set of positivity constraints. 

Case II. The frequencies a, b are commensurable. Assume that Na = 
Mb where N, M are positive integers. Then the decomposition above of 
a positive (on [0,1]) element / G M[x, e ax , e bx ] holds modulo the algebraic 
relation = y^f- 

Example 7. When dealing with trigonometric (real valued) polynomials in 
n variables, one has to consider the algebra A = R[sin0j, cos 1 < i < n. 
The standard lifting proposed in the present article is 

yi = sinflj, Zi = cos 0j, 1 < i < n, 

modulo the ideal generated by the relations 

yf + zf -1 = 0, l<i<n. (2.3) 

Note that in this case every quadratic module Q C A in the variables 
sin#j,cos#j lifts to an archimedean quadratic module Q in the variables 
yi,Zi. Specifically, relations (|2.3p assure that the constant function 1 be- 
longs to the algebraic interior of Q. 

3. Representation of positive semi-algebraic functions 

We now consider an algebra of functions which forms an important sub- 
class of semi- algebraic functions. 

Let (gj)j^-i C M[x] and let K C W l be the basic semi-algebraic set 

K:= {x£R": #(x) > 0, j = !,..., m}. (3.1) 

Recall that / : K — > R is a semi- algebraic function if its graph fyf := 
{(x, /(x)) : x G K} is a semi-algebraic set of W 1 x M. 
Recall the notation 

a V b = max[o, b] ; a A b := min[a, 6]; |x| = . . . , |x n |) G M n , 
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and let A be the algebra of fonctions / : K — > R generated by finitely many 
of the dyadic operations {+, x,/,V,A} and monadyc operations | • | and 
(•)V p (pgjsj) on polynomials. 

For instance, with u,v,£ G M[x] and h G M[x] 2 , q G N, the function 

x-> /(x) := (|n(x) +v(x)\ 1 h A (^/jj^j || 2g+ i + l/*(x)) (3.2) 

is a member of A (assuming of course that ^(x) > or £(x) < for all 
xGK). 

Definition. A function / G A is said to have a basic semi-algebraic lifting 
(in short a "b.s.a.l."), or / is basic semi- algebraic (b.s.a.) if there exist 
p, s G N, polynomials (/ifc)|=i C M[x, yi, . . . ,y p ] and a basic semi-algebraic 
set 

K' 7 := {(x, y) G : x G K; fc fc (x, y) > 0, fc = 1, . . . , s} 

such that the graph of / (denoted satisfies: 

* /: ={(x,/(x)) : XGK} = {(x,y p ) : (x,y)GK' / }. (3.3) 

In other words, is an orthogonal projection of the basic semi-algebraic 
set Ky. which lives in the lifted space M n+P . 

Hence by the projection theorem of real algebraic geometry, a function 
/ G A that admits a b.s.a.l. is semi-algebraic. 

Lemma 3. Let K be the basic semi- algebraic set in \2. Then every well- 
defined f G A has a basic semi-algebraic lifting. 

Proof. It is obvious that the sum f + g and multiplication fg of two b.s.a. 
functions f,g G A, is b.s.a. So let / G A be b.s.a., i.e., 

* / = {(x,y p ) : (x,y)GK' / ClR n+ P} 

for some integer p and some basic semi-algebraic set K^. Then: 

• If / ^ on K then / _1 has the b.s.a.l. 

V f -i = {(x,y p+1 ) : (x, (yi, . . . ,y p )) G K'; y p+ iy p = 1} 

and so f/g is b.s.a. whenever / and g are. 

• With / > on K and q G N, f l / q has the b.s.a.l. 

*/x/ 5 = {(x,y p+ i) : (x, (yi,. . . ,y p )) G K'; = y p ; y p+1 > 0} 

• \f\ has the b.s.a.l. 

#|/| = {(x,2/p+l) : (x, (yi, • • • ,y P )) G K'; y 2 +1 = y 2 ; y p+ i > 0} 

• If / and y have a b.s.a.l. then so does /Ay (resp. / V y) because 
2(/Ay) = (/ + y)-|/-y| (resp. 2(/ V y) = (/ + g) + |/ - y|). 

□ 
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Example 8. Let / € A be the function defined in (|3.2p . and let K'^ C R' 
be the basic semi-algebraic set defined by the constraints: 

= { (x, y) G R" +9 : fc(x) > 0, j = l,. 

yf-hiiyif = 0; W > 0; 

yl q+l -vl q+l -yl q+l = o ; ys >o 

y 4 ^(x) = 1; 

2/5 _ 2/4 - 2/3 = 0; y 5 > 

y 2p - (n(x) + v( X ) f = 0; y 6 > 

2/7 ~ (2/6 - 2/5) 2 = 0; y 7 > 

22/s - (2/6 + 2/5) + 2/7 = } 
Then^ / = {(x,y 8 ) : (x,y)eK}}. 

Observe that with each variable y^ of the lifting y is associated a certain 
function Vk £ «4- For instance in Example [HJ 

-> «i(x) := |/*(x)|, i = 1, 2; y 3 -»• Us(x) := Mx) 2 « +1 +« 2 (x) 2 <' +1 ) 1/(29+1) 
y 4 ->■ u 4 (x) := (^(x)" 1 ; y 5 ->■ w 5 (x) := i/^W + ^(x) 
y 6 -> u 6 (x) := |u(x) + u(x)| 1/p ; y 7 -> « 7 (x) := |u 6 (x) - u 5 (x)| 
and y 8 -> v 8 (x) := /(x). 

Next, with K C R n as in (13. ip . consider the set S C K defined by: 

S:={x6K:^(x)>0,i=l,... 1 i} (3.4) 
for some finite family (hk)f. =1 C A. 

Lemma 4. The set S in \3.J$ is a semi-algebraic set which is the projection 
of a lifted basic semi- algebraic set. It can be written 

S = {x G R n : 3y e R* s.t. x 6 K; u fe (x,y)=0, k = l,...,r 

Vj > 0, J € J} (3.5) 

for some integers r,t, some polynomials {uk) r k=l C R[x, y] and some index 
set J C {1, ...,t}. 

With the lifting y is associated a vector of functions v € A t . 

Proof. By Lemma El each function he is b.s.a. and so there is an integer ni 
and a basic semi- algebraic set C R n+n< such that: 

^ = {(x,j4) : (x,y f ) EK^}, £ = 1, . . . , s, 

with y*ER"',f = l,...,s. Therefore, 

S = {xel» : 3y 1 ,...,y s s.t. (x,y* ) G K' e ; > 0; £=1,. ..,«}, 

and so S is the projection of a lifted basic semi- algebraic set which lives in 
EP+Ei^ Obviously it is of the form (|3"3j) . □ 

Next we state the main result of this section. 



i = 1,2. 



POSITIVITY AND OPTIMIZATION FOR SEMI-ALGEBRAIC FUNCTIONS 15 

Theorem 2. Let K C W 1 be a compact basic semi- algebraic set as in ( 13. 1}) 
and let S be as in fi3.4\ ) for some finite family {hi) C A. Let f G A have the 
b.s.a.l. 

V f = {{x,z mf ) : xGK; %(x,z) = 0, £ = l,...,t f 
Zj > 0, j € J/} 

(where z = (zi, . . . , z m/ ) and J C {1, . . . ,irif}) and let p = (pi, . . . , p m/ ) G 
A mf be the vector of functions associated with the lifting z. 
If f is positive on S then 

rn 

/(x) = <7 (x,v(x),p(x)) +^crj(x,v(x),p(x))#j(x) 

i=i 

+ v(x),p(x))v fc (x) (3.6) 

fceJ 

+ ^ £ ( x ' v ( x )> p( x )) p<K x ) ( 3 - 7 ) 

+^o(x,v(x),p(x))(M - ||(x, v(x),p(x))|| 2 ) (3.8) 

for some (o - ,-), (V'fc)) (w) C SK[x,y,z] and a sufficiently large M > 0. 

Example 9. The following simple example illsutrates why the b.s.a. func- 
tions are much nicer than general semi-algebraic functions. Let A = M[x, xs] 
be the algebra generated by the polynomials in the variables i£l and the 
characteristic function of a basic algebraic set, say for simplicity given by a 
single inequality 

S = {x G K; h(x) > 0} 
where ft £ is a non-zero polynomial. An element / G A is of the form 
/ = fixs + M^- — Xs)i with /i,/2 G Let Q G i be an archimedean 

quadratic module with associated positivity set P(Q). The question whether 
f\p(Q) > reduces therefore to (fi)\p(Q)ns > an d independently 
(h)\p(Q)\s > 0- While the first condition is reducible to the above setting 

(fl)\p(Q+h£R[x] 2 ) > 0, 

the second condition involves the positivity of the polynomial fi on a non- 
closed semi- algebraic set. This case can be resolved in general only with the 
help of Stengle's Positivstellensatz, see for details [Tl [22] . 

To be more explicit, consider h(x) = \\x\\ 2 — 1 and Q = T,W[x] 2 + (2 — 
||x|| 2 )£IR[x] 2 . We are then led to consider the problem 

Mx) > whenever ||a;|| 2 < 1, (3-9) 

where fi is a polynomial in x. Stengle's Theorem states that the im- 
plication (|3.9j) holds if and only if there exists a positive integer N and 
Oi G SM[x] 2 , < % < 3, such that 

Ma + (1 - ||x|| 2 )<n) = (1 - \\x\\ 2 ) 2N + a 2 + (1 - \\x\\ 2 )a 3 . 
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In conclusion, even if the graph of the characteristic function xs is semi- 
algebraic, a departure from the requirement that it is a (lifted) basic semi- 
algebraic set implies that the sought certificate of positivity of an element 
/ G A requires denominators. 

4. SEMI-ALGEBRAIC OPTIMIZATION 

In this section we consider the application of preceding results to opti- 
mization of a function / of the algebra A, over a compact set S as in (|3.4p 
(with K as in (|3.1j) ) and whose defining inequality constraints are also de- 
fined with functions in this algebra A. Recall that by Lemma [4j the set S 
can also be written as the projection (13, 5j) of a basic semi-algebraic set in a 
lifted space R n+t . 

Consider the optimization problem: 

P: /* := min { /(x) : x € S } (4.1) 

X 

Proposition 8. With K in $3. 1\) compact and with S as in (3^ )- $3J$ , let 
f G A have the b.s.a.l. 

*/ = {(x,z f ) : x G K; q t (x,z) = 0, £ = l,...,t f 
Zj > 0, j e J f } 

(where z = (zi, . . . , z mf ) and J C {1, . . . , mf} ) and let p = (pi, . . . , p m/ ) G 
A mf be the vector of functions associated with the lifting z. Then P is also 
the polynomial optimization: 

f* = min {z m : (x,y,z) G tt} 

x,y,z ' 

where O C M n+t+m f is the basic semi- algebraic set 



ft = {(x,y,z) : 




>o, 


j = 


1,.. 


. , m 




ffc(x,y) 


= 0, 


k = 


1,.. 


. . ,r 






= 0, 


1 = 


1,.. 


.,t f 




Vk,zj 


>o, 


k G 


J, J 


G J f } 



(4.2) 



The proof follows directly from LemmaH]and the definiton of the b.s.a.l.^/. 

Then one may apply the moment-sos approach developed in e.g. |17} [19] 
and build up a hierarchy of semidefinite programs whose associated sequence 
of optimal values converges to the global optimum /*. 

That is, with w = (w a ^ 7 ) being a real sequence indexed in the index set 
N n x N* x N m f, let L w : K[x, y, z] -> R be the linear functional 

P{= /. ! Pa/37 X°y^ z7 ) ^ L w(p) := ^p Q/ 3 7 W a /3 7 - 

a/37 a /37 

Let 9 G R[x, yz] be the quadratic polynomial 

(x,yz) ^ 0(x,y,z) := M — ||(x,y,z)|| 2 , 
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with M such that M > ||(x, y, z)|| 2 on Q, and let au '■= |"(deg«fc)/2] and 
be := \(degqe)/2], for every k = 1, . . . , r, t = 1, . . . , tf. 
For i > maxy[flfc,t|], consider the semidefinite program 

Pi = min woorn f 



Afi(w) 


h o 










Mj_ afe (u fc w) 




k 




l,.. 


-,r 


Mj„^ w) 


>r0, 


£ 




l,.. 




Mi_i( % w) 


^0, 


3 


e 


J 




Mi_i(^w) 


ho, 


3 


G 


Jf 




Afi_i(0w) 


h o 










^000 


= l. 











(4.3) 



Theorem 3. Consider the hierarchy of semidefinite programs \4-!fy . 

(a) The sequence {pi) is monotone nondecreasing and pi — > f* as i — > oo. 

(b) Let w l be an optimal solution of and assume that 

rankMj(w) = rankMj_ c (w) =: d, (4.4) 

whre c := maxj, ktae . Then pi = f* and w is the moment sequence of a 
d-atomic probability measure supported on d points of the set $7 defined in 

Proof. As P is a standard polynomial optimization problem, the proof fol- 
lows directly from e.g. [171 119]. □ 

Theorem [3] is illustrated below on the following two simple examples: 

Example 10. Let n = 2 and P : /* = max{ |a;i| £2 — %\ ■ || x || 2 = !}• 

X 

Hence 

n = {(x, z) : ||x|| 2 - 1 = 0; z 2 - x\ = 0; z > 0}. 

Observe that \x\\ < 1 on K = {x : ||x|| 2 = 1} and so one may choose 
#(x, z) := 3 — ||(x, z)|| 2 . At the second relaxation (|4,3p the rank condition 
(|4.4p is satisfied with d = 2, and one obtains f*=P2 = 0.2071 with the two 
optimal solutions: 

(x*,z*) = (0.3827, 0.9239, 0.3827); (x*,z*) = (-0.3827, -0.9239, 0.3827). 
Example 11. Let n = 2 and P : /* = maxirci \x± — 2x2\ : llxll 2 = 1}. 

X 

Hence 

n = {(x, z) : ||x|| 2 - 1 = 0; z 2 - (x 1 - 2x 2 ) 2 = 0; z > 0}. 

Observe that \xi — 2x 2 \ < 3 on K = {x : ||xj| 2 = 1} and so one may choose 
9(x,z) := 11 — || (x, z)\\ 2 . At the second relaxation (|4.3p the rank condition 
(|4.4p is satisfied with d = 1, and one obtains f* = P2 = 1-6180 and the 
optimal solution: (x*,z*) = (0.8507, -0.5257, 1.9021). 

Remark, (a) A usual lifting strategy (well-known from optimizers) to han- 
dle optimization problems of the form P : min x {/(x) : x G K}, with 
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/(x) = maxj G j /j(x) for some finite index set J, is to use only one lifting z 
and solve 

min { z : x € K, z > / 7 (x), j G J}. 

Similarly with /(x) = |<?(x)| one uses z > ±g(x). In this case one has 
only one additional variable with no equality constraint. In particular, this 
lifting preserves convexity (when present). But this lifting is valid in some 
particular cases only and for instance it does not work if / is replaced with 
/(x) = /i(x) - max j6 j[/ 3 (x)], or /(x) = /i(x) - \g(x)\. 

(b) In the description of the set Q, a "lifting" y e is associated with each 
non polynomial function hi € A that appears in the description of P, as 
well as a lifting z for / (if non polynomial). This can be rapidly penalizing. 
However it is worth noting that there is no mixing between the lifting vari- 
ables z and y , as well as between the lifting variables y e of different ^'s. 
The coupling of all these variables is through the variables x. Hence there 
is an obvious sparsity pattern if the set of all variables (x, y, z) is written as 
the union (with overlaps) 

(x,y,z) = (x) U (x,z) U (x,y x ) U ••• U (x,y s ) 

and this sparsity pattern obviously satifies the co-called running intersection 
property, because for each 1 < k < s, 

(x,y fc+1 ) p| ((x) U (x,z) U\ =1 (x,y*)) C (x). 

See e.g. [H]. This is a good news because with such a sparsity pattern one 
may use the sparse semidefinite relaxations defined in [28], whose associ- 
ated sequence of optimal values was still proved to converge to /* in [18] . 
Hence if on the one hand lifting is penalizing, on the other hand the special 
structure of the lifted polynomial optimization problem permits to use spe- 
cialized "sparse" relaxations, which (partly) compensates the increase in the 
number of variables. For more details on sparse semidefinite relaxations, the 
interested reader is referred to e.g. [18] and [28]. And finally, one should also 
bear in mind that the original problem P being very hard, there is obviously 
some price to pay for its resolution! 
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